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■ ABSTRACT ^ * 

As student evaluations become more commonplace and 
increasingly influential in assessing teaching, it becomes important 
to. gain skill in JijLte^^ such. data« To ^determine the effect of 

.class'^-hour (one potentially contamihat^^^ variable) on students' 
ratings, an analysis \iks made of ratings given the same instructor on 
the same course in the same quarter by students enrolled in^Jlifferent 
sections. Mot only did: the statistic used reveal a significant 
differehce from one cl^s hour**to ahoth^^ it alsp^ supported the , , 

. assertion of ^con:^istent tr.^at4n€nt; within it :is recommended, 

therefore, that student evaluations hot always be taken ^t face 
value. (Author) * 
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'THE EFFECT OF CLASS HOUR ON STUDENT EVALUATION 



OF TEACHER PERFOR^IANCE 



00. 



W'. Gelger Ellis, University of Georgia .. ' 

% The -purpose of this study was to determine whether or not -the hour at 
•.which :a class meets influences the student evaiuations pf a teacher/s per- 
.fdrmafice. Further, if class hour is relatea to students* evaluations of a 
teacheir^s performance, at which hoiir will students give a teacher more 
favorable ratings of his pjrlEpr mane e? • ' 

fp discover the answers to these questions, the investigator after 
final examinations had students in two classes anonymously complete the 
•eighteen-item "Student Course Evaluation", used throughout the College of 
Education at the University. of Georgia. On the first Hay of the academic 
quarter, all students who were to take a particular-required course were . 
called together, and each was assigned to one of two class hours, 8:00 a.m. 
or 12:10 p.m. The assignment was done first on the basis of student prefer- 
ence and then on, the basis of-^ scheduling necessity. Since this is a common 
practice, the findings of this study should be applicable to the great ^ 
-majority oL situations, where this procedure is" followed. 

As all the students were majorfng in secondary English education, their 



academic backgrounds were quite similar.. Em:"o1:lmen1r^Ti^the-course-used In- 
the study is limited to students who have met a specified standard of academic 
, performance both in English, their major, and in all previous academic work 
regardless of subject area. Also, each student had completed at least 135 
quarter hours of work. - ^ , ' . 



^The instructor, who taugKt botKTclasses, hadt\taught Uie same course , 
tnanytipes during previous quarters so that the later class did^ot benefit 
t'tdm a practice effect on the instructors The sapo schedule of activities 
was followed explicitly so that. the same topics and attivities were encovm- 
ter(ed i>y all .students on the same days and in the same sequence* Both classes 
wefevcbnducted in the same room with the , same materials and equipment. ^ 

— . The student ratiir^ on each .of the eighteen items were totalled for - 
each of .the tWb classes, as shown in Table 1, and the means of these student 

^ ratings are given in Figure 1, \ , . ' ' 



Class A 




Mean. Prof lies of Two Classes* Evaluations of Teacher^erformance 



As can be seen. Class A (the group meeting at 12:10 p.m.) assigned the . 
instructor higher ratings on every one. of the eighteen Items than did Class^B' 
• Cthe. group.nTeetin^ 'at 8:00 a.m.). Tlie essential question, though. Is- 
i whether this difference is great enough to be attributable to some factor 
other than chance, iri the instance of this study, class hour.- A -method of 
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analysis of variance devised, by Greenhouse and Geisser^ was used to< 
answer this question. The results of the use of a conservative test are 
given in Table 3. ' ^ . ^ 

■ ^ - 

• TABLE 3 ^ 

. • «f 

Analysis, of Variance 



' — 


^ Source of Degrees of 
' Variation- Freedom 


Sum of 
Squares 


Mean 
Squares 




F 


Items 17 


, . 47.0012 
• 


'2.7648 


h 


- 15.00 .i 


Classes. ^ 1 


8.6717 


8.6717 




« 8.63 . 


individuals within 41 
classes ^ 


41.2045 


1.0050, 






Classes x Items 17 


3.6006 


..2118 




- , 1.15 • 


Individuals X. Items 697 
within classes 


128.4804, 


.1843 







a Of primary Interest is the F2 value which indicates that the classes 
clearly differ (p<.005) with regard to levels of rating. This-me^hs that 
In. the mean profiles the line for Class A has been found to be statistically 
significantly higher than the' line. for Class B. .It may therefore be stated 
that Classes meeting at 8:00 a,m. are more severe in their evaluation of 
teacher performance than- are classes which meet shortly after noont 

f * • • 

- ■ ■ . -. ] h ' — — <r / ^ > 

^*Samuel W. Greenhouse and Seymour Geisser, "On Methods in the Analysis 

of Profile Data,;' Psychometrika ; Vol. 24, No.. 2 (June, 1959) , 95-112. 



The small value indicates that there is not a;, significant difference 
in the profiles of the two classes* ratings. This means that in the mean 
profiles the .iines for the two' classes V means go up arid down together by 
item in such a way that consistency in- treatment* is, indi't a ted. As Green- . 
house and Geisser state in an example of the use of their analytic method, 
"Of primary interest is the test of the homogeneity of group profiles,: 
which is a. test, for the existence of the group - test interaction. For 
this purpose...- the F:^yaluei*r IhdicatesLsupport or rejection of ... the 
hypothesis of no interaction." The small F^ value in this study makes, it 
appropriate not to reject the hypothesis of no Interaction. Therefore, 
It may be concluded that the mean profiles do not differ, since no inter- 
action , has.. beeti- found* ' ^ ' "/ ^, 

^ Certainly, whenever there are two teaching performances there is th^ 

possibility of some difference. On the other hand^ all possible controls 

■ V V' . ^ . ■ ' " ' 

were exercised, to eliminate this possibility. Moreover, the consistency 

revealed by the small value makes vari'atioTHLn-performances-^a^hlghl y 

-J * ■ * * 

unlikely possibility in that it is improbably that a teaching performance 

which varie$^ from another would vary with a statlscally significant consis-. 

tency across all items in the 'rating instniment. Such a finding supports 

the contentiion that the teaching performance, as^ measured by the evaluation 

instrument, was held constant for the two classes. 

» ' * * * - 

The significantly (p<.005) large ¥^ value demonstrates tljat the \ . 
students believed that the various areas of te«ching performance measured 
by the .evaluation instrument were not. equally wfell executed, thereby 
precluding the possibility that ratings were given perfunctorily. The 
small Fj value, again, would tend to discourage the notion that perhaps* 
students assigned ratings rarfdomly without serious consideration being 
given^ to ^e teaching performance they had witnessed. 



As the practice of having students evaluate the teaching , performance 
of their instructors Is used ever more widely, it becomes increasingly 
important* to know nfore about the inffuence that factors other than actual 

- ' ' ; • ■ ' m • . * 

teaching performance may have on student evaluations of that performance* 
Ihfonfation of this jiature is necessary to a more accurate analysis of 
student reactions to teaching activities Otherwise, erroneous impressions 
.of a teacher *s performance may be formed on th^ basis of these student 

ratings* *\ ^ 

* ■ \ - 

. the/iiost .obvious implication of these findings is that an interpretation 
of student evaluatj^ns of teaching performance should not fail to take into 
.account the influence of the class hour* Since it may be that other factors 
also influence student evaluations, other studies should be undertaken to 
isolate them and to ascertain their influence. 



